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Abstract — This is a talk given at the conference Critical Dialogues in Cos- 
mology at Princeton University, June 24-27, 1996. It gives a brief summary of 
our present theoretical understanding regarding the value of the cosmological 
constant, and describes how to calculate the probability distribution of the ob- 
served cosmological constant in cosmological theories with a large number of 
subuniverses (i. e., different expanding regions, or different terms in the wave 
function of the universe) in which this constant takes different values. 
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1 Introduction 



The problem of the cosmological constant looks different to astronomers and 
particle physicists. Astronomers may prefer the simplicity of a zero cosmologi- 
cal constant, but they are also prepared to admit the possibility of a cosmological 
constant in a range extending up to values that would make up most of the criti- 
cal density required in a spatially flat Robertson- Walker universe. To a particle 
physicist, all the values in this observationally allowed range seem ridiculously 
implausible. 

To see why, it is convenient to consider the effective quantum field theory 
that takes into account only degrees of freedom with energy below about 100 
GeV, with all higher energy radiative corrections buried in corrections to the 
various parameters in the effective Lagrangian. In this effective field theory, the 
vacuum energy density that serves as a source of the long-range gravitational 
field may be written as 



where A is the cosmological constant appearing in the Einstein field equations, 
and the second term symbolizes the contribution of quantum fluctuations in 
the fields of the effective field theory, cut off at particle energies equal to 100 
GeV. Now, we know almost everything about this effective field theory — it 
is what particle physicists call the standard model — and we know that the 
quantum fluctuations do not cancel, so that on dimensional grounds, in units 
with h = c = 1, they yield 



On the other hand, observations do not allow py to be much greater than the 
critical density, which in these units is roug hly 10" 48 GeV 4 . Not to worry - 
just arrange that the Einstein term A has a value for which the two terms in 
Eq. (1) cancel to fifty-six decimal places. This is the cosmological constant 
problem: to understand this cancellation. 

Here I will consider three main directions for solving this problem|l|: 

• Deep Symmetries 

• Cancellation Mechanisms 

• Anthropic Constraints 

By a 'deep symmetry' I mean some new symmetry of an underlying theory, 
which is not an unbroken symmetry of the effective field theory below 100 GeV 
(because we know all these symmetries), but which nevertheless requires pv to 
vanish. In other contexts supersymmetry can sometimes play the role of a deep 
symmetry, in the sense that some dimensionless bare constants that are required 




(1) 




(2) 



1 



to vanish by supersymmetry can be shown to vanish to all orders in perturbation 
theory even though supersymmetry is spontaneously broken. Unfortunately the 
vacuum density is not a constant of this sort — it has dimensionality (mass) 4 
instead of being dimensionless, and it is a renormalized coupling rather than a 
bare coupling. Recently Witten has proposed a highly imaginative and specu- 
lative mechanism by which some form of supersymmetry makes py vanish I 
am grateful to the organizing committee of this conference for giving me only 
15 minutes to talk, so that I don't have to try to explain Witten's idea. I turn 
instead to the other two approaches on my list. 



2 Cancellation Mechanisms 

The special thing about having py — is that it makes it possible to find 
spacetime-independent solutions of the Einstein gravitational field equations. 
For such solutions, we have 

dC/dg^ = , (3) 

where C is the Lagrangian density for constant fields. The problem occurs 
only in the trace of this equation, which receives a contribution from py which 
for py ^ prevents a solution. Many theorists have tried to get around this 
difficulty by introducing a scalar field <f> in such a way that the trace of dC/ dg^ v 
is proportional to 5C/S4>: 

g^BC/dg^ = f(<P)5£/8<j> , (4) 

with /(</>) arbitrary, except for being finite. Where this is done, the existence 
of a solution of the field equation SC/5(f> — for a spacetime-independent <fr 
implies that the trace g^dC/dg^ = of the Einstein field equation for a 
spacetime-independent metric is also satisfied. The trouble is that, with these 
assumptions, the Lagrangian has such a simple dependence on <fi that it is not 
possible to find a solution of the field equation for cj>. This is because Eq. (4), 
together with the general covariance of the action J d 4 x£, tells us that, when 
the action is stationary with respect to variations of all other fields, it has a 
symmetry under the transformations 

5g\v = 2eg\v , $<P = -zf{4>) , (5) 

which requires the Lagrangian density for spacetime-independent fields g^ and 
4> to have the form 

C = c jfeTg exp ^4 J* jjj^J , (6) 

where c is a constant whose value depends on the lower limit chosen for the 
integral. For c ^ 0, there is no solution at which this is stationary with respect 
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to <ft. The literature is full of proposed solutions of the cosmological constant 
problem based on this sort of spontaneous adjustment of one or more scalar 
fields, but if you look at them closely, you will see that either they do not satisfy 
Eq. (4), in which case there may be a solution for <fi but it does not imply the 
vanishing of py, or else they do satisfy Eq. (4), in which case a solution of the 
field equation for (f> would imply a vanishing pv, but there is no solution of the 
field equation for (f>. To the best of my knowledge, no one has found a way out 
of this impasse. 

3 Anthropic Considerations 

Suppose that the observed subuniverse is only one of many subuniverses, in 
which py takes a variety of different values. This is the case for instance in 
theories of chaotic inflation^ , in which various scalar fields on which the vacuum 
energy depends take different values in different expanding regions of space. In 
a somewhat more subtle way, this can also be the case in some versions of 
quantum cosmology, where the wave function of the universe is a superposition 
of terms in which py takes different values, either because of the presence of 
some vacuum field (like the antisymmetric tensor gauge field introduced 
for this purpose by HawkingQ), or because of wormholes, as in the work of 
Coleman 

Some authors 0, ||, have argued that in quantum cosmology the dis- 
tribution of values of pv is very sharply peaked at pv = 0, which would im- 
mediately solve the cosmological constant problem. This conclusion has been 
challenged 0, and it will be assumed here that the probability distribution of 
pv is smooth at pv — 0, without any sharp peaks or dips. 

In any theory of this general sort the measured effective cosmological con- 
stant would be much smaller than the value expected on dimensional grounds 
in elementary particle physics, not because there is any physical principle that 
makes it small in all subuniverses, but because it is only in the subuniverses 
where it is sufficiently small that there would be anyone to measure it. For 
negative values of pv, this limitation comes from the requirement that the sub- 
universe must survive long enough to allow for the evolution of life||. For 
positive values of pv (which are observationally more promising) the limitation 
comes from the requirement that large gravitational condensations like galax- 
ies must be able to form before the subuniverse begins its final exponential 
expansion Jl0|. 

If you don't find this sort of anthropic explanation palatable, consider the 
following fable. You are an astronaut, sent out to explore a randomly chosen 
planet around some distant star, about which nothing is known. Shortly before 
you leave you learn that because of budget cuts, NASA has not been able to 
supply you with any life-support equipment to use on the planet's surface. You 
arrive on the planet, and find to your relief that conditions are quite tolerable — 
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the air is breathable, the temperature is about 300° K, and the surface gravity 
is not very different from what it is on earth. What would you conclude about 
the conditions on planets in general? It all depends on how many astronauts 
NASA has sent out. If you are the only one then it's reasonable to infer that 
tolerable conditions must be fairly common, contrary to what planetologists 
would have naturally expected. On the other hand, if NASA has sent out a 
million astronauts, then all you can conclude about the statistics of planetary 
conditions is that the number of planets with tolerable conditions is probably not 
much less than one in a million — for all you know, almost all of the astronauts 
have arrived on planets that cannot support human life. Naturally, the only 
astronauts in this program that are in a position to think about the statistics 
of planetary conditions are those like you who are lucky enough to have landed 
on a planet on which they can live; the others are no longer worrying about it. 

In previous work[fl0| I calculated the anthropic upper bound on the cosmo- 
logical constant, which arises from the condition that py should not be so large 
as to prevent the formation of gravitational condensations on which life could 
evolve. This bound is naturally larger than the average value of the cosmologi- 
cal constant that would be measured by typical observers, which obviously gives 
a better estimate of what we might find in our subuniverse. (Vilenkin|TT| has 
advocated this point of view under the name of the 'principle of mediocrity', 
but did not attempt a detailed analysis of its consequences.) The difference 
is important, because the anthropic upper bound on py is considerably larger 
than the largest value of py allowed by observation. 

I will leave the observational limits on the cosmological constant to Dr. 
Fukugita's talk, but without going into details, it seems that for a spatially flat 
(i.e., k = 0) universe, py is likely to be positive and somewhat larger than the 
present mass density po, but probably not larger than 3po|l2|]. On the other 
hand, we know that some galaxies were already formed at redshifts z w 4, at 
which time the density of matter was larger than the present density po by a 
factor (1 + z) 3 ss 125. It therefore seems unlikely that a vacuum energy density 
much smaller than 125po could have completely prevented the formation of 
galaxies, so the anthropic upper bound on py cannot be much less than about 
125poi which is much greater than the largest observationally allowed value of 
py. 

In contrast, we would expect the anthropic mean value of py to be roughly 
comparable to the mass density of the universe at the time of the greatest rate 
for the accretion of matter by growing galaxies, because it is unlikely for py 
to be much greater than this and there is no reason why it should be much 
smaller. (I will make this more quantitative soon.) Although there is evidence 
that galaxy formation was well under way by a redshift z « 3, it is quite possible 
that most accretion of matter into galaxies continues to lower redshifts, as seems 
to be indicated by cold dark matter models. In this case the anthropic mean 
value < py > will be considerably less than the anthropic upper bound, and 
perhaps within the range allowed observationally. 
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I would like to present an illustrative example of a calculation of the whole 
probability distribution of the cosmological constant that would be measured 
by observers, weighted by the likelihood that there are observers to measure 
it. Instead of the very simple model|l3|] of galaxy formation from spherically 
symmetric pressureless fluctuations used previously jHj, here I will rely on the 
well-known model of Gunn and Gott [fl4|| , which also assumes spherical symmetry 
and zero pressure, but takes into account the infall of matter from outside the 
initially overdense core. This is still far from realistic, but it will allow me 
to make four points about such calculations, which should be more generally 
applicable. 

As shown in earlier workj^, the condition for a spherically symmetric fluc- 
tuation to recondense is that 

where p and Ap are the average density and the overdensity in the fluctua- 
tion at some early initial time, say the time of recombination. Previously Ap 
was assumed to be uniform within a spherical fluctuation, but Eq. (7) actually 
applies to any sphere, with Ap understood to be the spatially averaged initial 
overdensity within the sphere. 

Suppose that the fluctuation at recombination consists of a finite spherical 
core of volume V with positive average overdensity Sp, outside of which the 
density takes its average value p. (This picture is appropriate for well separated 
fluctuations. The effects of crowding and underdense regions will be considered 
in a future paper.) Then the average overdensity within a larger volume V 
centered on this core is Ap = SpV/V. Assuming that Eq. (7) is satisfied by the 
average overdensity Sp within the core, 



500 (Sp) 3 



> Pv , (8) 

recomb 



729 p 

the average overdensity Ap will satisfy the condition (7) out to a volume 

1/3 



v m 



so the total mass that will eventually collapse is 

/ 500p \ 1/3 



M = 5pV + pVw = V Sp 



\729pvJ 



(9) 



Once a galaxy forms, the subsequent evolution of stars and planets and life is 
essentially independent of the cosmological constant (this is point 1), so the 
number of independent observers arising from a given fluctuation at the time of 
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recombination is proportional to the mass (9) for those fluctuations satisfying 
Eq. (8), and is otherwise zero. Of course, the value of the cosmological constant 
might be correlated with the values of other fundamental constants, on which 
the evolution of life does depend, but the range of anthropically allowed cosmo- 
logical constants is so small compared with the natural scale (2) of densities in 
elementary particle physics that within this range it is reasonable to suppose 
that all other constants are fixed. (This is point 2.) The range of values of py 
for which gravitational condensations are possible is also so much less than the 
average density at the time of recombination, that the number of fluctuations 
Af(Sp, V) dV d5p with volume between V and V + dV and average overdensity 
between Sp and Sp + d5p should be nearly independent of pv ■ (This is point 3.) 
If V(pv) dpv is the a priori probability that a random subuniverse has vacuum 
energy density between pv and pv + dpv, then according to the principles of 
Bayesian statistics, the probability distribution for observed values of pv is 



Finally, the range of values of pv for which gravitational condensations are 
possible is so small compared with the natural scale of densities in elementary 
particle physics that within this range the a priori probability V(pv) may be 
taken as constant. (This is point 4-) The factor 'P(pv) may therefore be omitted 
in the probability distribution (10). Also, all anthropically allowed values of pv 
are much smaller than the mass density p at recombination, so we may neglect 
the 1 in the square brackets in Eq. (10), which now becomes 



Strictly speaking, this gives the probability distribution only for pv > 0. 
For pv < and k = 0, all mass concentrations that are large enough to allow 
pressure to be neglected will undergo gravitational collapse. The number of 
astronomers is instead limited (9) for py < by the fact that the subuniverse 
itself also collapses, in a time 




where 
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(12) 
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In contrast, the probability distribution for py > is weighted by an py- 
independent factor, the average time T in which stars provide conditions favor- 
able for intelligent life. The probability distribution for negative values of pv is 
small except for values of \pv\ that are small enough so that T(|py|) is less than 
or of order T. It will be assumed here that T is very large, so that V Q hs{pv) is 
negligible for py < except in a small range near zero, and may therefore be 
neglected in calculating the mean value of py. 

Using the probability distribution (12) and interchanging the order of the 
integrals over dp and py, we easily see that the mean value of observed values 
of py is 

. 200 <Sp 6 > 

{PV) = 729 «V >p2 ' (U) 
with all quantities on the right-hand side evaluated at the time of recombination, 
and the brackets on the right-hand side (unlike those in (pv)) indicating averages 
over fluctuations: 

poo 

<f(Sp)>= / dSp Af(Sp) f(Sp) . (15) 
Jo 

It remains to use astronomical observations to calculate the fluctuation spec- 
trum Af(6p) for the density fluctuations at recombination, which can then be 
used in Eq. (12) to calculate the probability distribution for py. Here I will just 
give one example of how information about the time of formation of galaxies 
can put constraints on < py > . With a positive py , the core of a fluctuation 
with average overdensity bp at recombination will collapse at a time when the 
average cosmic density p co \\ is less than it would be at the time of core collapse 
forp y =0:@ 

500 Sp 3 
243 ttV 

with p and Sp on the right-hand side evaluated at recombination. Using this in 
Eq. (14) gives a mean vacuum density 



<Pv> > . (17) 

Even if we suppose for example that core collapse occurs for most galaxies at 
a redshift as low as z « 1, then p co n 8po, so Eq. (19) gives < py > > lOpo, 
which exceeds current experimantal bounds on py. On the other hand, the 
median value of py is less than the mean value, so the discrepancy is less than 
this. Even so, it seems that most galaxies must be formed quite late in order 
for the value of py in our universe to be close to the value that is anthropically 
expected. 



At the meeting in Princeton I learned of an interesting paper by Efstathiou||15[ 
in which he calculated the effect of a cosmological constant on the present num- 
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ber density of L* galaxies, which he took as a measure of the distribution func- 
tion Vobs(pv)- In this calculation he adopted a standard cold dark matter 
model for matter density fluctuations, with amplitude at long wavelengths fixed 
by the measured anisotropy of the cosmic microwave background. Efstathiou 
found that for a spatially flat universe the galaxy density falls off rapidly (say, 
by a factor 10) for values of py around 7 to 9 times the present mass density 
Po, so that <py> I pQ should be less than of order 7 to 9, giving a contribution 

= Pq/(pq + Pv) °f matter to the total density somewhat greater than around 
0.1, which is consistent with lower bounds on the present matter density. 

At first sight this seems encouraging, but there are a few problems with 
Efstathiou's calculation. For one thing, as pointed out by Vilcnkin||i"lj|, the 
probability distribution of observed values of pv is related to the number of 
galaxies (or, more accurately, the amount of matter in galaxies) that ever form, 
rather than the number that have formed when the age of the universe is at 
any fixed value, as assumed by Efstathiou. However, this will not make much 
difference if most galaxy formation is complete in typical subuniverses when 
they are as old as our own subuniverse. Efstathiou also encountered another 
problem that is endemic to this sort of calculation. The cosmological parame- 
ters that can reasonably be assumed to be uncorrelated with the cosmological 
constant are the baryon-to-entropy ratio and the spectrum of density fluctu- 
ations at recombination, because these are presumably fixed by events that 
happened before recombination, when any anthropically allowed cosmological 
constant would have been negligible. But the only way we know about the 
spectrum of density fluctuations at recombination is to use observations of the 
present microwave background (or possibly the numbers of galaxies at various 
redshifts), and unfortunately the results we obtain from this for Af(Sp) depend 
on the value of the cosmological constant in our subuniverse. In calculating 
'Pobs(pv) one should ideally make some assumption about the value of py in 
our subuniverse, then use this value to infer a spectrum of density fluctuations 
at recombination from the observed microwave anisotropies, and then calculate 
the number of galaxies that ever form as a function of py, with the spectrum of 
density fluctuations at recombination held fixed. Instead, Efstathiou calculated 
the number of L* galaxies as a function of py , with the microwave anisotropies 
held fixed, which gave V hs(pv) an additional spurious dependence on py. This 
problem was known to Efstathiou, and apparently did not produce large errors. 

There is one other problem, that did have a significant effect in Efstathiou's 
calculation. He relied on the standard methodjl^] of calculating the evolution 
of density fluctuations using linear perturbation theory, and declaring a galaxy 
to have formed when the fractional overdensity Ap/p reaches a value <5 C , which 
is taken as the fractional overdensity of the linear perturbation at a time when a 
nonlinear pressureless spherically symmetric fluctuation would recollapse to infi- 
nite density. He took the effective critical overdensity for spatially flat cosmolo- 
gies as S c = 1.68/Oq 28 , with Slo = 1 — Pv/Pait, so that 5 C ~ 3.2 for fig = 0.1. 
But numerical calculations of Martel and Shapiro |17| show that for all fluctua- 
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tions that result in gravitational recollapse, 5 C is in a range from 1.63 to 1.69. 
The upper bound 1.69 is the well-known result S c = (3/5)(3tt/2) 3 / 2 = 1.6865 
for pv = 0. The lower bound 1.63 can also be understood analytically pj: it is 
the critical overdensity for the case where pv has a value that just barely allows 
gravitational recollapse 

With 5 C always between these bounds, it is impossible that the effective value of 
S c for any ensemble of fluctuations could be greater than 1.69. Overestimating 
S c biases the calculation toward late galaxy formation, with a corresponding 
increased sensitivity to relatively small values of pv- Efstathiou has now re- 
done his calculations with S c given the constant value 1.68, which should be a 
good approximation, and, as I interpret his results, he finds that this change in 
5 C roughly doubles the value of pv at which the present density of L* galaxies 
drops by a factor 10, with a corresponding reduction in the expected value of 
rio- It remains to be seen whether this change in his results will lead to a conflict 
with observational bounds on f2 an( i Pv- 

At present Martel and Shapiro are carrying out a numerical calculation of 
V ohs using Eq. (12). 

I am grateful for helpful discussions with George Efstathiou and Paul Shapiro. 
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